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(54) IMAGING SYSTEM 
(57)Abstract 

PROBLEM TO BE SOLVED: To provide an imaging system 
capable of imparting a suitable gray- scale width to a main 
object in an image regardless of an area and a position of the 
object. 

SOLUTION: In an imaging system generating one image with 
wide dynamic range from more than one image imaged at 
different exposures, the system comprises an estimation part 14 
for main object range to assume a main object range among 
images from a focus-locked focusing detecting range, a suitable 
exposure extracting part 13 to extract a suitable exposure 
range based on the level of an image signal image-by-image 
among a group of the images, a conversion characteristic 
calculation part 15 to execute a gray-scale correction to deliver 
the gray-scale width mainly to the assumed main object range 
for the extracted suitable exposure range, a brightness 
corrective part 16, a color- difference corrective part 17, a Y/C 
combining part 18 and an image combining par 20 to generate 
one image with wide dynamic range by combining the suitable 
exposure range of each image executed the gray-scale 
correction through the parts 1 5-18. 

* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3 Jn the drawings, any words are not translated. 



CLAIMS 



CCIaim(s)] 

[Claim 1]An imaging system which processes an image group which consists of two or more pictures 
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picturized by a different exposing condition to the same photographic subject, and generates a wide 
dynamic range image of 1 r comprising: 

An estimation means which presumes a main object area in a picturized picture. 

An extraction means to extract an appropriate exposure area based on a picture signal level for every 
picture in a described image group. 

A compensation means which performs gray level correction so that a gradation range may be 
preponderantly distributed to a main object area presumed by the above-mentioned estimation means to 
an appropriate exposure area extracted by this extraction means. 

A synthesizing means which generates a wide dynamic range image of 1 by compounding an appropriate 
exposure area of each picture which performed gray level correction by this compensation means. 

[Claim 2]An imaging system which generates a picture by which gradation was amended by acjjusting a 
gradation range of a picturized picture characterized by comprising the following. 
An estimation means which presumes a main object area in a picturized picture. 

A compensation means which performs gray level correction of a picture picturized [ above-mentioned ] 
so that a gradation range may be preponderantly distributed to a main object area presumed by this 
estimation means. 

[Claim 3]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

An object image setting^out means to set up a picture of a middle-of-the-screen part which is a 
focusing detection area at the time of the focus lock of the above-mentioned estimation means being 
carried out as an object image. 

An object image set up by this object image setting^out means. 

A matching means which performs matching with a picture picturized at the time of this photography* 
An area setting means which sets up a field in this above-mentioned taken image judged that matching 
with the above-mentioned object image is the maximum by this matching means as a main object area. 

[Claim 4]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following* 

A stroboscope means to irradiate with illumination light with light quantity which the imaging system 
concerned precedes performing this photography, and performs Puri photography of multiple times and 
from which the above-mentioned estimation means differs for every Puri photography of the above- 
mentioned multiple times. 

A memory measure which memorizes two or more pictures concerning lighting in different light quantity 
produced by carrying out Puri photography. 

A distance calculation means which computes distance information by reading a picture at the time of 
the Puri photography memorized by this memory measure, and taking a ratio of a luminance signal of 
each picture. 

An area selling means which sets up a field in a distance equivalent to focus distance at the time of 
this photography as a main object area based on distance information computed from this distance 
calculation means. 

[Claim 5]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

A memory measure which memorizes a picture acquired by the imaging system concerned preceding 
performing this photography, performing Puri photography, and the above-mentioned estimation means 
carrying out Puri photography, 

An area setting means which sets up a field wrth difference beyond a prescribed threshold value as a 
main object area based on difference information acquired from a difference means to acquire difference 
information with a picture acquired by reading a picture at the time of the Puri photography memorized 
by this memory measure, and carrying out actual photography, and this difference means. 

[Claim 6]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
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following. 

An image display means in which the above-mentioned estimation means has a touch-panel function. 
An area setting means which sets up a field specified with the touch-panel function of this image display 
means as a main object area, 

[Claim 7]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

An image display means by which the above-mentioned estimation means was divided into a field of two 
or more prescribed sizes. 

A selecting means which chooses at least one field in two or more above-mentioned fields, and an area 
setting means which sets up a field where this selecting means was selected as a main object area. 

[Claim 8]Tha imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

An infrared sensor means by which the above-mentioned estimation means acquires an infrared 
distributed situation of a photographic subject field which abbreviated-corresponds to a picture 
picturized, 

A candidate area setting-out means to set up a field beyond a predetermined threshold as a candidate 
area from an infrared part situation acquired by this infrared sensor means. 

A beige detection means to detect a beige ingredient to a candidate area set up by this candidate area 
setting-out means. 

An area setting means which sets up a field judged that a beige ingredient Is included by this beige 
detection means as a main object area. 

[Claim 9]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

A reception means which receives a remote control signal with which it is constituted so that it may 
become possible for the imaging system concerned to take a photograph according to remote control 
which used a remote control device, and the above-mentioned estimation means is transmitted from the 
above-mentioned remote control device. 

A direction calculating means which computes the dispatch direction of a remote control signal received 
by this reception means, and an area setting means which sets up a field of prescribed size of the 
dispatch direction computed by this direction calculating means as a main object area. 

[Claim 10]The imaging system according to claim 1 or 2 being a thing characterized by comprising the 
following. 

A weighting-factor setting~out means by which the above-mentioned compensation means sets up a 
weighting factor that dignity of the above-mentioned main object area becomes heavy as compared with 
fields other than this main object area. 

A feature quantity calculation means which computes characteristic quantity from a picture which 
picturized [ above-mentioned ]. 

A weighting -factor set up by the above-mentioned weighting-factor setting-out means. 
A histogram preparing means which creates a histogram with dignity based on characteristic quantity 
computed by the above-mentioned feature quantity calculation means, and a gray-scale-conversion 
curvilinear calculating means which computes a gray-scale-conversion curve based on a histogram 
created by this histogram preparing means. 



[Translation done.] 
* NOTICES * 

JPO and INPIT arc not responsible for any 
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damages caused by the use of this translation. 

1This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated 
3,In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Held of the Invention]This invention relates to the imaging system which carries out gradation 
compression of the wide dynamic range image obtained by combining several pictures from which a light 
exposure differs, and outputs it or the imaging system which carries out gradation compression of the 
dynamic range of the taken image of 1, and outputs it. 

It is related with the imaging system which obtains a high definition outputted image by controlling 
appropriately the gradation range especially assigned to a major object 

[0002] 

[Description of the Prior Art]The thing of versatility [ imaging system / which picturizes a photographic 

subject electronically / former] is proposed. 

For example, an electronic camera is mentioned as an example. 

[0003]The general CCD image sensor used for such an electronic camera, Since there is the 
characteristic that the dynamic range about gradation is narrow compared with the silver halide film 
currently used for the conventional film-based camera, or [ carrying out black crushing of the other, if it 
picturizes so that either may serve as suitable exposure when the large photographic subject of shade 
difference is picturized. and the sunny place and the shade under blazing heat are picturized 
simultaneously, for example ] — or it may become the picture which white-flew. 

[0004]the large photographing scene of such shade difference — both a bright section and dark space - 
- although — several pictures from which a light exposure differs are combined, and the art which 
generates the wide dynamic range image of 1 is proposed so that it may reappear appropriately. 
[0005] However, by display output systems, such as the usual monitor and a printer, since the wide 
dynamic range image produced by doing in this way cannot be carried as it is, it needs to perform 
gradation compression. 

[0006]The imaging means which can generate the picture signal for two or more screens which 
picturizes the same photographic subject with several different light exposures to JP,20G0-50151 A and 
wrth which light exposures differ, for example in it as art of this gradation compression. In the imaging 
device provided with a means to compound the picture signal for two or more screens with which the 
light exposures obtained by this imaging means differ, and to generate extensive dynamic range image 
composing, The judging means which judges whether suitable image composing is obtained based on the 
picture signal for two or more screens taken a photograph. The switchover control means which 
switches generation processing operation of the above-mentioned image composing creating means to 
one or OFF based on the output of this judging means. The picture signal for two or more screens 
where preparation jM********* is indicated and which differs in the light exposure produced by 
picturizing the same photographic subject with several different light exposures further, The synthetic 
information used when compounding the picture signal for these two or more screens and generating 
extensive dynamic range image composing* The above-mentioned file is read from the recording medium 
currently recorded as one file, and the external synthesizer unit provided with the synthesizing means 
which compounds the picture signal for two or more screens in this file based on the synthetic 
information in this file, and generates extensive dynamic range image composing is indicated. 
[0007]The art of gradation compression is used also in the usual electronic camera which acquires the 
picture of one sheet by one image pick-up. Namely, since the image quality deterioration by cancellation 
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of significant digits may arise when performing digital signal processing, When the gradation bit (bit) of an 
inputted image may be set up more widely than the gradation bit of an outputted image and this setting 
out is made in order to prevent this, gradation compression will be performed eventually. So, in the 
conventional electronic camera, this gradation compression is generally processed by fixed gamma 
conversion, 

[0008]The art of acquiring a more nearly high-definition picture by performing contrast correction 
processing about the picture of one sheet is known. 

[0009] As such art, for example to JP r 1 1-55520 A The art of changing image levels is indicated based on 
the light-and-darkness adjust parameter which inputted image data, took cloth several gradient minutes, 
set up the corrected parameter of contrast based on cloth several of those gradient minutes, and was 
set up by this corrected parameter and user. 
[0010] 

[Problem(s) to be Solved by the Invention]"* carrying out in a Prior art by performing gradation 
compression by compressing on the average to the whole gradation range, or compressing by gamma 
conversion, as mentioned above, but. Thus, in a means to compress fixed, since it is not guaranteed, it 
does not necessarily become a desirable picture that a person's etc. major object has suitable gradation. 
When the means of such gradation compression is used, there is a tendency used as the flat picture 
which lacks in a contrast feeling as a whole. 

[0011]On the other hand, although a means to compress gradation accommodative in quest of a 
histogram from a picture is also proposed, since it is based on the histogram, there is a tendency for 
much gradation to be given by the photographic subject with a large area. For this reason, when a 
person's etc. major object is small photoed in the screen, the gradation of a major object serves as 
crushing feeling, and cannot acquire the optimal picture. 

[0012]In order to improve such a technical problem, the means using the histogram of an edge part is 
also proposed, assuming that a major object has many edge parts, but. For example, since there are few 
elements which serve as edge against the above-mentioned assumption when a major object is a 
person's face, the not much remarkable improvement effect has not been acquired. 
[0013]ln this way, art in which gradation compression can be performed is desired so that the gradation 
of a person's etc. major object may become more suitable especially. 

[0014]This invention is made in light of the above-mentioned circumstances, and it is not concerned 
with the area or the position of a major object within a picture, but aims at providing the imaging system 
which can give a suitable gradation range and can perform more nearly high-definition gradation 
compression. 
[0015] 

[Means for Solving the Problem]In order to attain the above-mentioned purpose, an imaging system by 
the 1st invention, An estimation means which presumes a main object area in a picture which is an 
imaging system which processes an image group which consists of two or more pictures picturized by a 
different exposing condition to the same photographic subject, and generates a wide dynamic range 
image of 1, and was picturized, An extraction means to extract an appropriate exposure area based on a 
picture signal level for every picture in a described image group, A compensation means which performs 
gray level correction so that a gradation range may be preponderantly distributed to a main object area 
presumed by the above-mentioned estimation means to an appropriate exposure area extracted by this 
extraction means. It has a synthesizing means which generates a wide dynamic range image of 1 by 
compounding an appropriate exposure area of each picture which performed gray level correction by this 
compensation means. 

[0016]An estimation means which presumes a main object area in a picture which an imaging system by 
the 2nd invention is an imaging system which generates a picture by which gradation was amended by 
adjusting a gradation range of a picturized picture, and was picturized, It has a compensation means 
which performs gray level correction of a picture picturized [ above-mentioned ] so that a gradation 
range might be preponderantly distributed to a main object area presumed by this estimation means. 
[0017]In an imaging system according [ an imaging system by the 3rd invention ] to the 1st or 2nd 
above-mentioned invention, An object image setting-out means to set up a picture of a middle-of-the- 
screen part which is a focusing detection area at the time of the focus lock of the above-mentioned 
estimation means being carried out as an object image. A matching means which performs matching with 
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an object image set uj> by this object image setting-out means, and a picture ptcturized at the time of 
this photography. It has an area setting means which sets up a field in this above-mentioned taken 
image judged that matching with the above-mentioned object image is the maximum by this matching 
means as a main object area. 

[0018]In an imaging system according [ an imaging system by the 4th invention ] to the 1st or 2nd 
above-mentioned invention, A stroboscope means by which it precedes performing this photography, 
Puri photography of multiple times Is performed, and the above-mentioned estimation means irradiates 
with illumination light with different light quantity for every Puri photography of the above-mentioned 
multiple times, A memory measure which memorizes two or more pictures concerning lighting in 
different light quantity produced by carrying out Puri photography, A distance calculation means which 
computes distance information by reading a picture at the time of the Puri photography memorized by 
this memory measure, and taking a ratio of a luminance signal of each picture, It has an area setting 
means which sets up a field which is in a distance equivalent to focus distance at the time of this 
photography based on distance information computed from this distance calculation means as a main 
object area. 

[001 9]In an imaging system according [ an imaging system by the 5th invention ] to the 1st or 2nd 
above-mentioned invention, A memory measure which memorizes a picture acquired by preceding 
performing this photography, performing Puri photography, and the above-mentioned estimation means 
carrying out Puri photography, A difference means to acquire difference information with a picture 
acquired by reading a picture at the time of the Puri photography memorized by this memory measure, 
and carrying out actual photography. It has an area setting means which sets up a field which has the 
difference beyond a prescribed threshold value based on difference information acquired from this 
difference means as a main object area, 

[0020]In an Imaging system according [ an imaging system by the 6th invention ] to the 1st or 2nd 
above-mentioned invention. The above-mentioned estimation means has an Image display means which 
has a touch-panel function, and an area setting means which sets up a field specified with the touch- 
panel function of this image display means as a main object area. 

[0021]In an imaging system according [ an imaging system by the 7th invention J to the 1st or 2nd 
above-mentioned invention, The above-mentioned estimation means has an image display means divided 
into a field of two or more prescribed stees, a selecting means which chooses at least one field in two or 
more above-mentioned fields, and an area setting means which sets up a field where this selecting 
means was selected as a main object area* 

[0022]ln an imaging system according [ an imaging system by the 8th invention ] to the 1st or 2nd 
above-mentioned invention. An infrared sensor means by which the above-mentioned estimation means 
acquires an infrared distributed situation of a photographic subject field which abbreviated-corresponds 
to a picture picturized, A candidate area setting-out means to set up a field beyond a predetermined 
threshold as a candidate area from an infrared part situation acquired by this infrared sensor means, It 
has a beige detection means to detect a beige ingredient to a candidate area set up by this candidate 
area setting-out means, and an area setting means which sets up a field judged that a beige ingredient 
is included by this beige detection means as a main object area. 

[0023]ln an imaging system according [ an imaging system by the 9th invention ] to the 1st or 2nd 
above-mentioned invention, A reception means in which it is constituted so that photography by remote 
control using a remote control device may be attained, and the above-mentioned estimation means 
receives a remote control signal transmitted from the above-mentioned remote control device. It has a 
direction calculating means which computes the dispatch direction of a remote control signal received 
by this reception means, and an area setting means which sets up a field of prescribed size of the 
dispatch direction computed by this direction calculating means as a main object area. 
[0024]ln an imaging system according [ an imaging system by the 10th invention ] to the 1st or 2nd 
above-mentioned invention, A weighting-factor setting-out means by which the above-mentioned 
compensation means sets up a weighting factor that dignity of the above-mentioned main object area 
becomes heavy as compared with fields other than this main object area, A histogram preparing means 
which creates a histogram with dignity based on a feature quantity calculation means which computes 
characteristic quantity, and a weighting factor set up by the above-mentioned weighting-factor setting- 
out means and characteristic quantity computed by the above-mentioned feature quantity calculation 
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means from a picture which picturized [ above-mentioned ]. It has a gray-scale-conversion curvilinear 
calculating means which computes a gray-scale-conversion curve based on a histogram created by this 
histogram preparing means, 
[0025] 

[Embodiment of the Invention]Hereafter r an embodiment of the invention is described with reference to 
drawings. The block diagram in which drawin g 4 s hows a 1st embodiment of this invention from drawin g 
1, and drawing,!. shows the composition of an imaging system, the block diagram in which drawing 2 
shows the example of composition of a main object area estimating part, the figure in which drawing 3 
shows the example of composition of an operation display, and drawing 4 a re the block diagrams showing 
the composition of a transfer characteristic calculation part 

[0026]The imaging system of this 1 st embodiment was constituted as an electronic camera, for example, 

[0027]First, with reference to drawing 1, the composition of the imaging system of this 1st embodiment 
is explained. 

[0028]The lens system 1 for carrying out image formation of this imaging system to CCD 4 which 
mentions an object image later, The diaphragm 2 for specifying the passage range of the light flux which 
passes this lens system 1, The low pass filter 3 which removes an unnecessary high frequency noise 
from the light flux which passed the above-mentioned lens system 1, CCD4 which becomes by color 
CCD etc. of the single plate type which carried out photoelectric conversion of the light figure by which 
image formation was carried out outputs as an electrical signal of an analog, and was provided with the 
electronic shutter function after passing this low pass filter 3, A/D converter 5 which changes into a 
digital signal the video signal of the analog outputted from this CCD4, The buffer 6 for pictures which 
accumulates the image data outputted from this A/D converter 5, While detecting luminosity, a focusing 
position, etc. of a photographic subject and controlling the amount of diaphragms of the above- 
mentioned diaphragm 2, and the electronic shutter of above-mentioned CCD4 based on the image data 
outputted from this picture buffer 6 P The Image pick-up control section 7 which is outputted to the AF 
motor 8 which mentions a lens driving control signal later, and is outputted to the stroboscope 23 which 
mentions a strobe light control signal later, and the AF motor 8 which drives the focus lens contained in 
the above-mentioned lens system 1 based on the lens driving control signal outputted from this image 
pick-up control section 7, Are an estimation means which irradiates with the illumination light towards a 
photographic subject based on the strobe light control signal outputted from the above-mentioned 
image pick-up control section 7, and The stroboscope means slack stroboscope 23, The interpolation 
area 9 which changes into the image data of 3 tabular voice the image data of a single plate state 
outputted from the buffer 6 for described images, The operating buffer 10 which accumulates the image 
data of the 3 tabular voice outputted from this interpolation area 9, The estimation means slack 
operation display 1 1 which displays a picture in order to specify a main object area based on the image 
data outputted from this operating buffer 10, while having various kinds of operation switches so that it 
may mention later. The Y/C separation part 12 which divides into the luminance signal Y and the color- 
difference signal C the image data outputted from the above-mentioned operating buffer 1 0, Are an 
estimation means which presumes the major object within a picture to be the extraction means slack 
appropriate exposure extraction part 13 which extracts an appropriate exposure area based on the 
luminance signal Y outputted from this Y/C separation part 12 based on the image data outputted from 
the buffer 6 for described images, and The area setting means slack main object area estimating part 14, 
The compensation means slack transfer characteristic calculation part 15 computed while carrying out 
weighting of the transfer characteristic of the appropriate exposure area extracted by the above- 
mentioned appropriate exposure extraction part 13 so that the gradation of the msuor object presumed 
by the above-mentioned main object area estimating part 14 may become suitable, The compensation 
means slack luminance correction part 16 which performs gray level correction of the luminance signal Y 
based on tha transfer characteristic computed by the above-mentioned transfer characteristic 
calculation part 15 about the appropriate exposure area extracted by the above-mentioned appropriate 
exposure extraction part 13, The compensation means slack color difference amendment part 17 which 
performs gray level correction of the color-difference signal C outputted from this Y/C separation part 
12 based on the luminance signal before and behind the conversion outputted from the above- 
mentioned Y/C separation part 12 and the luminance correction part 16, and the theoretical marginal 
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model in which a color may exist. The Y/C synchronizer 18 which compounds the luminance signal Y 
after the gray level correction outputted from the above-mentioned luminance correction part 16 r and 
the color-difference signal C after the gray level correction outputted from the above-mentioned color 
difference amendment part 17, The operation buffer 19 which memorizes the image data of the 
appropriate exposure area by which gray level correction was carried out The synthesizing means slack 
image synthesis section 20 which compounds two or more image data concerning different exposure 
memorized by this operation buffer 19 based on the appropriate exposure area information from the 
above-mentioned appropriate exposure extraction part 13 r and generates the wide dynamic range image 
of one sheet The wide dynamic range image compounded by this image synthesis section 20 For 
example, the outputting part 21 outputted to storages, such as a memory card and a hard disk, or an 
external device. Each circuit in this imaging system that acquires information from the above-mentioned 
image pick-up control section 7. the interpolation area 9, the operation display 11. the Y/G separation 
part 12, the appropriate exposure extraction part 13, the main object area estimating part 14, the 
transfer characteristic calculation part 15, the Y/C synchroniser 18, the image synthesis section 20, and 
outputting part 21 grade, and contains these. It controls in generalization, for example, it has the control 
section 22 which becomes with a microcomputer etc.. and is constituted 

[0029]Next an operation of the imaging system constituted in this way is explained in accordance with 
the flow of a signal as shown in drawing 1 . 

[0030]If the shutter button which Is provided in this imaging system that becomes with an electronic 
camera and which is not illustrated is half-pressed as mentioned above for example, it will go into the 
Puri photographing mode performed in advance of this photography* 

[0031]Via the above-mentioned diaphragm 2 and the low pass filter 3. the object image, as for. image 
formation was carried out by the above-mentioned lens system 1 is changed into an electrical signal by 
CCD4. and is outputted as a video signal of an analog. After being changed into a digital signal by A/D 
converter 5. this video signal is transmitted to the buffer 6 for pictures, and is accumulated. 
[0032]The size of this buffer 6 for pictures serves as capacity memorizable by the seriography for which 
the image data of this gradation range is needed, if the gradation range of the digitized signal in this 
embodiment shall be 10 bits. 

[0033]The image data memorized in the buffer 6 for described images is read after that and is 
transmitted to the Image pick-up control section 7 as a video signal 

[0034]While this image pick-up control section 7 asks for the luminance level in a picture, sets up a 
diaphragm value, shutter speed, etc. which serve as appropriate exposure and controlling the above- 
mentioned diaphragm 2 and CCD4, It controls to obtain a focused image by making the lens system 1 
drive via the above-mentioned AF motor 8 so that the edge intensity in a picture may be detected and 
this edge intensity may serve as the maximum. After the lens system 1 drives to a focusing position in 
this Puri photographing mode, while continuing half press of the shutter button, this focusing position is 
fixed, is maintained and will be in what is called a focus lock state. The photography person can change 
flaming now freely in the meantime, 

[0035]Next this photography is performed by pressing the above-mentioned shutter button fully. The 
picture (short time exposure picture) of the 1st sheet is photoed to the exposing condition searched for 
by the above-mentioned image pick-up control section 7 by a predetermined exposure ratio, for 
example, an exposing condition which is set to 1/8, and after being changed into a digital signal by A/D 
converter 5, it is transmitted to the buffer 6 for pictures, and memorizes. 

[0036]Then, after the picture (long exposure picture) of the 2nd sheet is photoed by the exposing 
condition searched for by the image pick-up control section 7 and being changed into a digital signal by 
above-mentioned A/D converter 5, rt is transmitted to the buffer 6 for pictures, and memorizes. 
[0037]The interpolation area 9 reads the video signal of a single plate state memorized by the buffer 6 
for described images one by one according to control of the control section 22. performs publicly known 
interpolation processing, white balance processing, emphasis processing, etc., generates the signal of 3 
tabular voice, and transmits it to the operating buffer 10. 

[0038]According to control of the control section 22, the operation display 1 1 is read in order to display 
the long exposure picture on the above-mentioned operating buffer 10. 

[0039]According to control of the control section 22. the Y/C separation part 12 reads 3 board signals 
on the above-mentioned operating buffer 10 in order of a long exposure picture and a short time 
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exposure picture, and divides each into the luminance signal Y and the color-difference signal C. 
[0040]The field (non-appropriate exposure area) where the luminance signal concerning a fong exposure 
picture serves as exposure over by the appropriate exposure extraction part 13 is extracted, and the 
signal of fields (appropriate exposure area) other than this is transmitted to the transfer characteristic 
calculation part 15 and the luminance correction part 16. 

[0041]ln the case of the luminance signal concerning a short time exposure picture, the luminance signal 
corresponding to the above-mentioned non-appropriate exposure area is transmitted by the above- 
mentioned appropriate exposure extraction part 13 to the transfer characteristic calculation part 15 and 
the luminance correction part 16» 

[0042]According to control of the control section 22. the main object area estimating part 14 reads the 
picture and long exposure picture at the time of the Puri photography from the buffer 6 for described 
images, and it asks for a main object area and it transmits the result searched for to the transfer 
characteristic calculation part 15 so that it may mention later from these pictures. 
[0043]The transfer characteristic calculation part 15 makes weighting the main object area to which the 
cumulative histogram of the luminance signal sent from the above-mentioned appropriate exposure 
extraction part 13 has been sent from the above-mentioned main object area estimating part 14, is 
created, and generates the conversion curve for performing gray scale conversion based on the 
cumulative histogram. 

[0044]The luminance correction part 16 changes the luminance signal concerning a long exposure 
picture, and the luminance signal concerning a short time exposure picture based on the conversion 
curve sent from the above-mentioned transfer characteristic calculation part 15. The luminance signal 
after conversion is transmitted to the color difference amendment part 17 and the Y/C synchronizer 18. 

[0045!lThe color difference amendment part 17 receives the luminance signal after conversion from the 
above-mentioned luminance correction part 16 while receiving the luminance signal before conversion 
from the above-mentioned Y/C separation part 12. And based on the luminance signal before and 
behind these conversion, and the theoretical marginal model in which a color may exist, the correction 
factor for amending a color-difference signal is computed, and the multiplication of this correction 
factor is carried out to the color-difference signal sent from the above-mentioned Y/C separation part 
12. 

[0046]The amended color-difference signal is transmitted to the Y/C synchroniser 18, is compounded 
with the luminance signal after the conversion sent from the above-mentioned luminance correction 
part 1 6, and is saved in order of a long exposure picture and a short time exposure picture as a usual 
video signal at the operating buffer 19. 

[0047]According to control of the control section 22, the image synthesis section 20 compounds the 
long exposure picture after gray scale conversion, and the short time exposure picture after gray scale 
conversion, generates the wide dynamic range Image of one sheet based on the information sent from 
the above-mentioned appropriate exposure extraction part 13 # and transmits it to the outputting part 
21. 

[O048]Next, with reference to drawing 2 (A), the 1st example of the composition of the above-mentioned 
main object area estimating part 14 is explained. 

[O049]The main object area estimating part 14 in this example of composition. According to control of 
the above-mentioned control section 22. the picture and long exposure picture at the time of the Puri 
photography are read from the buffer 6 for described images, The changeover section 31 which 
transmits these to the Puri taken Image buffer 32 and this taken image buffer 35 r respectively. The Puri 
taken image buffer 32 which memorizes the picture at the time of the Puri photography sent from this 
changeover section 31, The field of the middte-of~the-screen part of the picture at the time of the Puri 
photography memorized by this Puri taken image buffer 32 to prescribed size (it is the focusing 
detection area used at the time of the above-mentioned focus lock, and) The object image setting-out 
means slack trimming part 33 which starts the field considered to be a meu'or object of photography. The 
object image buffer 34 which memorizes the object image cut down from this trimming part 33, This 
taken image buffer 35 which memorizes the long exposure picture sent from the above-mentioned 
changeover section 31, According to control of the matching means slack matching part 36 which 
performs pattern matching processing between the object image considered to be a major object on the 
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above-mentioned object image buffer 34. and the long exposure picture on this above-mentioned taken 
image buffer 35, and transmits the result to the region setting part 37. and the above-mentioned control 
section 22, The field in the long exposure picture judged that matching is the highest by the above- 
mentioned matching part 36 is set up as a main object area, and it has the area setting means slack 
region setting part 37 which transmits the result to the above-mentioned transfer characteristic 
calculation part 15, and is constituted. 

[Q050]Since the picture which this main object area estimating part 14 reads from the buffer 6 for 
described images is a single plate picture, it is also performing pattern matching processing by the 
above-mentioned matching part 36 in the state of the single plate. Thereby, it can be said that the 
accuracy of matching is enough to achieve the function to still ask for the rough field of a major object 
although it falls a little. Of course, it is possible not only this but to perform pattern matching processing 
based on the picture information memorized by the above-mentioned operating buffer 10 after 
performing interpolation processing and making it 3 tabular voice. 

[005l]Then, with reference to dr awi ng 4, an example of the composition of the above-mentioned 
transfer characteristic calculation part 15 is explained 

[0052]The weighting-factor setting-out means slack weighting-factor calculation part 70 which sets up 
a weighting factor to which the dignity of the main object area where this transfer characteristic 
calculation part 15 was presumed by the above-mentioned main object area estimating part 14 
according to control of the control section 22 becomes heavy as compared with the other field, 
According to control of the above-mentioned control section 22, it reads into the order which mentions 
the luminance signal concerning each exposure image later from the appropriate exposure extraction 
part 13, The pixel which has the edge intensity beyond a predetermined threshold from the edge image 
extracted by the feature quantity calculation means slack edge extracting part 71 which performs 
publicly known edge extraction, and this edge extracting part 71 is sorted out. The histogram preparing 
means slack histogram preparing part 72 which carries out the multiplication of the weighting factor 
outputted from the above-mentioned weighting-factor calculation part 70, performs weighting, and 
creates a histogram. By accumulating the histogram outputted from this histogram preparing part 72, it 
has the gray-scale-conversion curvilinear calculating means slack conversion curve calculation part 73 
which generates a conversion curve and is transmitted to the above-mentioned luminance correction 
part 16, and is constituted. 

[0053]This transfer characteristic calculation part 15 creates the conversion curve which starts a long 
exposure picture as the luminance signal which is not involved [ above-mentioned ] appropriate 
exposure extraction part 13, but starts a long exposure picture was read and mentioned above, Next, 
the conversion curve which reads the luminance signal concerning a short time exposure picture, and 
starts a short time exposure picture similarly is created. 

[0054]In this way, the photographic subject which performed the focus lock at the time of the Puri 
photography is judged to be a major object by composition as shown in above-mentioned drawing 2 (A), 
and composition as shown in above-mentioned draw ing 4 enables it to perform gray scale conversion 
which carried out weighting to this major object Since the gradation range assigned to a major object 
increases by this, a desirable picture can be acquired subjectively. 

[0055]Next, with reference to dr awing 2 (B), the 2nd example of the composition of the above- 
mentioned main object area estimating part 1 4 is explained. 

[0056]The example shown in this drawing 2 ( B) photos the strobe image of two or more sheets in which 
light quantity differs by the Puri photographing mode, asks for the parameter which is proportional to 
object distance from these, and sets up the object in a distance equal to a focal distance as a major 
object 

[0057]Namely, the main object area estimating part 14 in this example of composrtion, According to 
control of the control section 22, the picture at the time of the Puri photography at the time of not 
making light emit with the picture at the time of the Pun photography at the time of making a 
stroboscope emit light is read from the buffer 6 for pictures, The changeover section 41 which transmits 
these single plate pictures to the 1st picture buffer 42 and the 2nd picture bufFer 44, respectively. The 
1 st picture bufFer 42 of memory measure slack that memorizes the picture at the time of the Puri 
photography at the time of making the stroboscope sent from this changeover section 41 emit light The 
luminosity calculation part 43 which computes a luminance signal after reading image data from this 1st 
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picture buffer 42 and performing publicly known linear interpolation processing. The 2nd picture buffer 
44 of memory measure slack that memorizes the picture at the time of the Puri photography at the time 
of not making the stroboscope sent from the above-mentioned changeover section 41 emit light, The 
luminosity calculation part 45 which computes a luminance signal after reading image data from this 2nd 
picture buffer 44 and performing publicly known linear interpolation processing. According to control of 
the distance calculation means slack division part 46 which searches for distance information so that 
the dividing process of the luminance signal from the above-mentioned luminosity calculation part 43 
and the luminance signal from the above-mentioned luminosity calculation part 45 may be carried out 
and they may be mentioned later, and the control section 22, It has the area setting means slack region 
setting part 47 which sets up a main object area based on the distance information searched for by the 
above-mentioned division part 46 f and is outputted to the above-mentioned transfer characteristic 
calculation part 15, and is constituted, 

[0058]Here, division of the luminance signal at the time of a strobe light and stroboscope 
nonluminescent is done by the above-mentioned division part 46, distance information is searched for, 
and the principle which sets up a main object area by the described area set part 47 based on this 
distance information is explained. 

[0059]The angle of the normal which stood the reflectance of the photographic subject to r and an 
object surface, and the optic axis of the above-mentioned lens system 1 to make alpha 1, For the 
luminosity of alpha 2 and a strobe light if distance to La and a photographic subject is set to d for the 
luminosity of external light sources other than Ls and a stroboscope, the angle of the normal stood to 
the object surface* and the direction which tends toward external light sources other than a 
stroboscope from this object surface to make, The pixel value V1 of the picture at the time of a strobe 
light is noting that the direction of radiation of a strobe light and the direction of the optic axis of the 
above-mentioned lens system 1 are mostly in agreement, [Equation 1]V1 It is set to =rxcos(alpha 1) 
xLs/d"2+rxcos(alpha 2) xLa. The sign expresses the exponentiation here, 

[0060]On the other hand, the pixel value V2 of the picture at the time of stroboscope nonluminescent is, 
[Equation 2]V2 It is set to =rxcos(alpha 2) xLa. 

[006l]If the ratio of the pixel value VI acquired by the above-mentioned expression 1 and the pixel 
value V2 acquired by the above-mentioned expression 2 is calculated, [Equation 3]V1 If V1 / V2 
obtained by the expression 3 remove the influence of direction of a field, etc. since it can be considered 
that Ls/La is an absolute term although it becomes {cos (alpha 1)/cos(alpha 2)} x{Ls/La]+1, it will be in 
inverse proportion to the square of the object distance A [ /V2 =(1/cf 2} x ] That is, the distribution in 
the photography screen of V1 / V2 turns into distribution depending on the object distance d. 
Therefore, the described area set part 47 can extract the field in focus distance as a major object by 
extracting a field equivalent to the value of the expression 3 in a focusing position, 
[0062]Then, with reference to dxawmg_2_(CX the 3rd example of composition of the above-mentioned 
main object area estimating part 14 is explained. 

[0063]When a major object is a person, since a very small motion arises in this major object with time 
progress, an example shown in this drawin g 2 (C) is set up as a major object in quest of a motion area 
from a picture photoed by the Puri photographing mode. 

[0064)The main object area estimating part 14 in this example of composition. The changeover section 
51 which reads a picture at the time of the Puri photography, and a long exposure picture of this 
photography from the buffer 6 for pictures, and transmits these single plate pictures to the 1st picture 
buffer 52 and the 2nd picture buffer 54 according to control of the control section 22, respectively, The 
1st picture buffer 52 of memory measure slack that memorizes a picture at the time of the Puri 
photography sent from this changeover section 51, The luminosity calculation part 53 which computes a 
luminance signal after reading Image data from this 1 st picture buffer 52 and performing publicly known 
linear interpolation processing, The 2nd picture buffer 54 of memory measure slack that memorizes a 
long exposure picture sent from the above-mentioned changeover section 51, The luminosity calculation 
part 55 which computes a luminance signal after reading image data from this 2nd picture buffer 54 and 
performing publicly known linear interpolation processing, According to control of the difference means 
slack subtraction part 56 which asks for a motion area by carrying out subtraction treatment of a 
luminance signal from the above-mentioned luminosity calculation part 53, and the luminance signal from 
the above-mentioned luminosity calculation part 55, and the control section 22, By extracting a motion 
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area which is within the limits of predetermined from a motion area called for by the above-mentioned 
subtraction part 56, and making this into a figure area, it has the area setting means slack region setting 
part 57 which sets up a main object area and is outputted to the above-mentioned transfer 
characteristic calculation part 1 5, and is constituted. 

[0065]When asking for a motion area by the subtraction part 56, it is good to be made to carry out after 
removing influence which the whole picture shifts by a shaking hand etc. 

[0066]Although only a motion area was extracted and a major object is detected in ****. it is also 
possible to perform highly precise person detection by performing matching with beige data or formed 
data further. 

[0067]The example shown in drawlng_2j0) from above-mentioned jdrawing_2jA) can also specify a main 
object area with hand control here, although this imaging system asked for a main object area 
automatically. 

[0068] A concrete example of composition of the operation display 11 which can specify a main object 
area by such manual operation is explained with reference to drawin g 3. 

[0069]First the operation display 1 1 of an example of composition shown in drawin g 3 (A). Have a 
touch-panel function which reads image data memorized by the above-mentioned operating buffer 10 
while displaying various kinds of information concerning this imaging system, and displays a picture, and 
The image display means slack liquid crystal 61 in which a pen input is possible. Liquid crystal ON / OFF 
switch 62 for setting up whether this liquid crystal 61 is displayed The image display means slack pen 
input switch 63 for switching whether a pen input to the above-mentioned liquid crystal 61 is made 
possible. The numerical keypad 64 which becomes with a ten key used in order to input a number etc. to 
this imaging system, It is an image display means for becoming final and conclusive an item with the 
selecting means slack selection key 65 used when choosing an item etc. which are displayed on the 
above-mentioned liquid crystal 61, and this selected selection key 65, and it has the selecting means 
slack settlement switch 66, and is constituted. 

[0070]When specifying a main object area manually using the operation display 1 1 of such composition, a 
video signal is made to read from the above-mentioned operating buffer 10, and it is made to display on 
the liquid crystal 61 by operating above-mentioned liquid crystal ON / OFF switch 62. 
[0071]And the above-mentioned pen input switch 63 is operated, and it shifts to pen input mode, and a 
main object area is specified by drawing a closed contour, contacting a tip of a pen which is not 
illustrated on the liquid crystal 61 . 

[0072]An inside of a specified closed contour is extracted as a main object area, and the above- 
mentioned control section 22 transmits to the above-mentioned main object area estimating part 14, 
and makes processing which was mentioned above perform by pushing the above-mentioned settlement 
switch 66 after that 

[0073]Next, although the operation display 1 1 of other examples of composition as shown in drawin g_3 
(B) is constituted almost like what was shown in above-mentioned drawjngJL(A). The usual image 
display means slack liquid crystal 68 is used instead of the above-mentioned liquid crystal 61 which has 
a touch-panel function, and a picture displayed on the above-mentioned liquid crystal 68 is farther 
classified into a block instead of the above-mentioned pen input switch 63, It differs in that the image 
display means slack block selecting switch 69 for setting it as the mode which chooses at least one 
classified block is formed. 

[0074]When specifying a main object area manually using the operation display 1 1 of such composition, a 
video signal is made to read from the above-mentioned operating bufFer 10, and it is made to display on 
the liquid crystal 68 by operating above-mentioned liquid crystal ON / OFF switch 62. 
[0075]And if it shifts to block selection mode with the above-mentioned block selecting switch 69, a 
picture currently displayed on the liquid crystal 68 will be divided into a block area of prescribed size. A 
specific block area is chosen by pushing the settlement switch 66 in a place which a photography 
person made move a block which serves as a selected candidate by operating the above-mentioned 
selection key 65 vertically and horizontally and where it moved on a major object 

[0076]The control section 22 extracts a specified block area as a main object area, is transmitted to the 
main object area estimating part 14. and makes processing which was mentioned above perform. 
[0077]AIthough **** explained a case where a long exposure picture and a picture of two sheets of a 
short time exposure picture were combined, Of course, this is an example, composition which is a light 
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exposure and which compounds a wide dynamic range image from a picture of many number of sheets 
rather than differing is also possible, or also when [ which is usually photography ] a picture of one 
sheet is acquired by one exposure, it is possible to apply to performing gray level correction. 
[0078]According to such a 1st embodiment, it is not concerned with area or a position of a major object 
in a picture, but a main object area in a picture is set up with automatic or hand control. Since gray 
scale conversion is performed so that much gradation may be assigned with this major object a picture 
to which desirable gray scale conversion was carried out more subjectively can be acquired. 
[0079] A block diagram in which drawn^_and drawjng_6lshow a 2nd embodiment of this invention, and 
drawing 5 s hows composition of an imaging system, and drawing 6 are the block diagrams showing an 
example of composition of a main object area estimating part In this 2nd embodiment, numerals same 
about the same portion as a 1 st above-mentioned embodiment are attached, explanation is omitted, and 
only a mainly different point is explained. 

[0080]While an imaging system of this 2nd embodiment removes the stroboscope 23 in an imaging 
system of a 1 st embodiment mentioned above, the operation display 1 1, the appropriate exposure 
extraction part 13, the operating buffer 19, and the image synthesis section 20, It has composition which 
newly added the infrared sensor 25 which served both as an estimation means, an infrared sensor 
means, and a reception means which detect two-dimensional infrared distribution images which 
abbreviated-correspond to a picture which is controlled by the above-mentioned image pick-up control 
section 7, and is picturized, and output the detection result to the above-mentioned main object area 
estimating part 1 4. 

[0081]Then, since it is equivalent to a 1st embodiment fundamentally mentioned above, an operation of 
this 2nd embodiment is explained only about a mainly different portion in accordance with a flow of a 
signal shown in drawjngji. 

[0082]By pushing a shutter button which is not illustrated, a picture of one sheet is picturized and this 
image data is transmitted to the buffer 6 for described images. 

[0083]This photography is interlocked with, the above-mentioned image pick-up control section 7 makes 
two-dimensional infrared distribution images incorporate into the infrared sensor 25, and that result is 
transmitted to the main object area estimating part 14 from the infrared sensor 25. 
[0084]On the other hand, a video signal memorized by the buffer 6 for described images is changed into 
a signal of 3 tabular voice by the interpolation area 9, and is transmitted to the operating buffer 10* 
[0085]According to control of the control section 22, the Y/C separation part 12 divides 3 board signals 
on the operating buffer 10 into the luminance signal Y and the color-difference signal C, and transmits 
the luminance signal Y of these to the transfer characteristic calculation part 15 and the luminance 
correction part 1 6. 

[0086]Accordingto control of the control section 22, the above-mentioned main object area estimating 
part 14 asks for a main object area so that it may mention later based on information outputted from 
the above-mentioned infrared sensor 25, and it transmits this to the transfer characteristic calculation 
part 15. 

[0O87]The transfer characteristic calculation part 15 makes weighting a main object area to which a 
cumulative histogram of the luminance signal Y sent from the above-mentioned Y/C separation part 12 
has been sent from the above-mentioned main object area estimating part 14, is created, and generates 
a conversion curve for performing gray scale conversion based on the cumulative histogram. 
[0088]Based on a conversion curve sent from the above-mentioned transfer characteristic calculation 
part 15, the luminance correction part 16 changes the luminance signal Y, and transmits it to the color 
difference amendment part 1 7 and the Y/C synchronizer 18. 

[0O89]While the color difference amendment part 17 receives a luminance signal before conversion from 
the Y/C separation part 12. A luminance signal after conversion from the luminance correction part 16 
is received, a correction factor for amending a theoretical marginal model in which a color may exist to a 
luminance signal before and behind these conversion and a color-difference signal is computed, and the 
multiplication of this correction factor is carried out to the coloi—drfference signal C sent from the 
above-mentioned Y/C separation part 1 2. 

[0090]The Y/C synchronizer 18 compounds a color-difference signal changed by the above-mentioned 
color difference amendment part 17 and a luminance signal changed by the above-mentioned luminance 
correction part 16, and transmits it to the outputting part 21 as a usual video signal. 
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[0091]Here. with reference to drawmg_6_.(A), an example of composition of the main object area 
estimating part 1 4 is explained. 

[0092]The binarization processing part 82 to which this main object area estimating part 14 carries out 
binarization of the infrared distribution images sent from the above-mentioned infrared sensor 25 
according to control of the control section 22 with a predetermined threshold. The candidate area 
setting-out means slack candidate area extraction part 81 which extracts a field more than constant 
temperature from infrared distribution images transmitted from this binarization processing part 82, and 
an image pick read from the buffer 6 for pictures as a candidate area of a major object, and performs 
linear interpolation processing about this candidate area. The picture buffer 83 which memorizes a 
candidate area transmitted from this candidate area extraction part 81 r The Y/C separation part 84 
which computes a color-difference signal by reading a candidate area memorized by this picture buffer 
83, The beige detection means slack beige data recording part 85 on which the range of a color- 
drfference signal applicable beige is recorded, Sy comparing with a color-difference signal which read 
the range of a oolor~difference signal applicable [ according to control of the control section 22 ] beige 
from the beige data recording part 85, and was transmitted from the above-mentioned Y/C separation 
part 84. It has the area setting means slack region setting part 86 transmitted to the transfer 
characteristic calculation part 15 by making into a main object area a field presumed that a person is 
included, and is constituted. 

[0093]Next with reference to drawing 6 ( B), other examples of composition of the main object area 
estimating part 1 4 are explained 

[0094]At the time of a teleradiography which uses an infrared remote control device, an example shown 
in this drawin g 6 (B) detects the direction of this remote control device, and sets up a field of 
prescribed size of that direction as a main object area. 

[0095] Namely, this main object area estimating part 14, The binarization processing part 91 which 
carries out binarization of the infrared distribution images outputted from the infrared sensor 25 
according to control of the control section 22 with a predetermined threshold. The direction calculating 
means slack maximum strength block extraction part 92 which makes a candidate area a block which 
divides into a block area of prescribed size infrared distribution images transmitted from this binarization 
processing part 91, and with which average value within each block serves as the maximum, The area 
setting means slack region setting part 93 transmitted to the transfer characteristic calculation part 15 
by making the direction of an infrared remote control device into a main object area from a signal 
transmitted from the buffer 6 for pictures according to control of the control section 22, and a 
candidate area transmitted from the above-mentioned maximum strength block extraction part 92. It is 
****<ed) and constituted. 

[0096]Although composition in usual [ which photos a picture of one sheet by one exposure in **** ] 
was explained. Composition of this 2nd embodiment can also be applied when combining a picture of 
three or more sheets concerning a long exposure picture, a picture of two sheets of a short time 
exposure picture, or different exposure not only like this but like a 1st embodiment mentioned above. 
[0097]While doing so the almost same effect as a 1st embodiment mentioned above according to such a 
2nd embodiment When a photographic subject is a person, while using an infrared sensor paying 
attention to emitting infrared rays according to body temperature etc., in order to distinguish from an 
object which emits infrared rays of further others, a main object area can be appropriately judged by 
comparing with beige data. And since a gradation range assigned to a major object by performing gray 
scale conversion which thought this major object as important increases, a desirable picture can be 
acquired subjectively. 

[0098]In performing a teleradiography using an infrared remote control device, In order that a 
photography person who served as a photographic subject may make this infrared remote control device 
emit light in a photography screen, rt becomes possible to specify the direction of a photographic 
subject by detecting maximum strength in infrared distribution images detected by an infrared sensor. 
[0099]As for this invention, it is needless to say for various modification and application to be possible 
within limits which are not limited to an embodiment mentioned above and do not deviate from main 
point of an invention. 
[0100] 

[Effect of the InventionjAs explained above, according to the imaging system of this invention by claim 
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1. By asking for the main object area and the appropriate exposure area of each picture in two or more 
pictures picturized by a different exposing condition, performing gray level correction and combining 
each picture so that a gradation range may be preponderantly distributed to a main object area, Since it 
is not concerned with the area or the position of a major object within a picture but the suitable 
gradation range for a major object is given, a high-definition picture can be acquired. 
[010l]By according to the imaging system of this invention by claim 2, asking for the main object area In 
the taken image of 1, and performing gray level correction so that a gradation range may be 
preponderantly distributed to a major object. Since it is not concerned with the area or the position of a 
major object within a picture but the suitable gradation range for a major object is given, a high- 
definition picture can be acquired. 

[0102]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 3, Since he is trying to ask for a main object area by making the 
focusing detection area at the time of a focus lock being carried out match with this taken image, a 
major object can be presumed using skillfully that a focus lock is carried out to a major object 
[0103]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 4, A major object can be presumed in good accuracy by searching for 
distance information from the speed-light-photography picture from which the light quantity at the time 
of the Puri photography differs, and making the field in a distance equivalent to the focus distance at 
the time of this photography into a main object area. 

[0104]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 5 f By considering it as a main object area in quest of a motion area, a 
major object can be. presumed by taking the difference of the Puri taken image and this taken image, 
using skillfully that there is a very small motion in a person. 

[0105]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 6, By setting up a major object position manually using the image 
display means which has a touch-panel function, the suitable gradation range for the field which a 
photography person means can be given. 

[0106]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 7, By choosing the field of an image display means, the suitable 
gradation range for the field which a photography person means can be given, and since the touch-panel 
function is unnecessary, it can constitute cheaply. 

[01 07]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 8. The major object in the case of being a person can be appropriately 
presumed by detecting the field which is emitting the infrared rays more than predetermined by the 
infrared sensor means, and detecting further the field which has a beige ingredient among these fields. 
[01 08]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 9. By computing the dispatch direction of a remote control signal and 
setting the field of the prescribed size of the dispatch direction to a main object area, the major object 
considered to operate by remote control using a remote control device can be presumed appropriately. 
[0109]While doing so the same effect as the invention according to claim 1 or 2 according to the imaging 
system of this invention by claim 10, By computing a gray-scale-conversion curve from the edge 
histogram which made weighting the main object area, it becomes possible to make the suitable 
gradation range for a major object give. 
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2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing t]The block diagram showing the composition of the imaging system in a 1st embodiment of 
this Invention, 

[Drawing 2]The block diagram showing the example of composition of the main object area estimating 
part in the imaging system of a 1st embodiment of the above. 

[Drawing 3]The figure showing the example of composition of the operation display in the imaging 
system of a 1 st embodiment of the above. 

[DrawjngjQThe block diagram showing the composition of the transfer characteristic calculation part in 
the imaging system of a 1 st embodiment of the above. 

[Drawing 5]The block diagram showing the composition of the imaging system in a 2nd embodiment of 
this invention. 

[ Drawin g 6]The block diagram showing the example of composition of the main object area estimating 
part in the imaging system of a 2nd embodiment of the above. 
[Description of Notations] 

1 — Lens system 

2 — Diaphragm 
4 — CCD 

7 — Image pick-up control section 
9 — Interpolation area 

11 — Operation display (estimation means) 

12 — Y/C separation part 

13 — Appropriate exposure extraction part (extraction means) 

14 — Main object area estimating part (an estimation means, area setting means) 

15 — Transfer characteristic calculation part (compensation means) 

16 — Luminance correction part (compensation means) 

1 7 — Color difference amendment part (compensation means) 

18 — Y/C synchronizer 

19 — Operating buffer 

20 — Image synthesis section (synthesizing means) 

21 — Outputting part 

22 — Control section 

23 — Stroboscope (an estimation means, stroboscope means) 

25 — Infrared sensor (an estimation means, an infrared sensor means, reception means) 
31, 41. 51 — Changeover section 

32 — The Puri taken image buffer 

33 — Trimming part (object image setting-out means) 

34 — Object image buffer 

35 — This taken image buffer 

36 — Matching part (matching means) 

37, 47, 57 — Region setting part (area setting means) 

42, 52 — The 1st picture buffer (memory measure) 

43, 45, 53, 55 — Luminosity calculation part 

44, 54 — The 2nd picture buffer (memory measure) 
46 — Division part (distance calculation means) 

56 — Subtraction part (difference means) 
61, 68 — Liquid crystal (image display means) 

62 — Liquid crystal ON / OFF switch 

63 — Pen input switch (image display means) 
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65 — Selection key (selecting means) 

66 — Settlement switch (an image display means, selecting means) 

69 — Block selecting switch (image display means) 

70 — Weighting-factor calculation part (weighting-factor setting-out means) 
7t — Edge extracting part (feature quantity calculation means) 

72 — Histogram preparing part (histogram preparing means) 

73 — Conversion curve calculation part (gray-scale-conversion curvilinear calculating means) 
81 — candidate area extraction part (candidate area setting-out means) 

82, 91 — Binarization processing part 

85 — Beige data recording part (beige detection means) 

86 — Region setting part (area setting means) 

92 — maximum strength block extraction part (direction calculating means) 

93 — Region setting part (area setting means) 
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[Drawing 2] 
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